Emergence of multimodal action representations from neural network self-organization

Emergence of multimodal action representations from neural network self-organization

The integration of multisensory information plays a crucial role in autonomous robotics to forming robust and meaningful representations of the environment. In this work, we investigate how robust multimodal representations can naturally develop in a self-organizing manner from co-occurring multisensory inputs. We propose a hierarchical architecture with growing self-organizing neural networks ...

Towards Emerging Multimodal Cognitive Representations from Neural Self-Organization

The integration of multisensory information plays a crucial role in autonomous robotics. In this work, we investigate how robust multimodal representations can naturally develop in a self-organized manner from co-occurring multisensory inputs. We propose a hierarchical learning architecture with growing self-organizing neural networks for learning human actions from audiovisual inputs. Associat...

Self-Organization and Emergence in Neural Networks

The interest for neural networks stems from the fact that they appear as universal approximators for whatever kind of nonlinear dynamical system of arbitrary complexity. Because nonlinear systems, are studied mainly to model self-organization and emergence phenomena, there is the hope that neural networks can be used to investigate these phenomena in a simpler way, rather than resorting to nonl...

Neural network, self-organization and object extraction

Ghosh, A., and S.K. Pal, Neural network, self-organization and object extraction, Paitern Recognition Letters l3 (1992) 387-397. Algorithms for object extraction nsing a nenral network are proposed. A single nenron (processor) is assigned here to every pixel for its operalion in order to implement {he concept of self-organized fealnre mapping. Both global and local information have been used as...

A Neural Network Architecture for Self-Organization of Object Understanding